翻訳と辞書
Words near each other
・ Pinsent Masons
・ Pinsent's Arm
・ Pinseque
・ Pinsetoppen
・ Pinsetter
・ Pinshape
・ Pinsk
・ Pinsk (disambiguation)
・ Pinsk District
・ Pinsk Marshes
・ Pinsk massacre
・ Pinsk Region
・ Pinsk-Karlin (Hasidic dynasty)
・ Pinsker
・ Pinsker's hawk-eagle
Pinsker's inequality
・ Pinsky
・ Pinsky phenomenon
・ Pinsley Mill
・ Pinsly Railroad Company
・ Pinson
・ Pinson High School
・ Pinson Mounds
・ Pinson Valley High School
・ Pinson, Alabama
・ Pinson, Tennessee
・ Pinsonfork, Kentucky
・ Pinsoperi
・ Pinsoro
・ Pinsot


Dictionary Lists
翻訳と辞書 辞書検索 [ 開発暫定版 ]
スポンサード リンク

Pinsker's inequality : ウィキペディア英語版
Pinsker's inequality
In information theory, Pinsker's inequality, named after its inventor Mark Semenovich Pinsker, is an inequality that bounds the total variation distance (or statistical distance) in terms of the Kullback–Leibler divergence.
The inequality is tight up to constant factors.
==Formal statement==
Pinsker's inequality states that, if P and Q are two probability distributions on a measurable space (X, \Sigma), then
:\delta(P,Q) \le \sqrt D_,
where
:\delta(P,Q)=\sup \bigl\
is the total variation distance (or statistical distance) between P and Q and
:D__ \left( \log \frac \right) = \int_ \left( \log \frac \right) \, \mathrm P
is the Kullback–Leibler divergence in nats. When the sample space X is a finite set, the Kullback–Leibler divergence is given by
:D_ \left( \log \frac\right) P(i)\!
Note that in terms of the total variation norm \| P - Q \| of the signed measure P - Q, Pinsker's inequality differs from the one given above by a factor of two:
:\| P - Q \| \le \sqrt.
The proof of Pinsker's inequality uses the partition inequality for ''f''-divergences.

抄文引用元・出典: フリー百科事典『 ウィキペディア(Wikipedia)
ウィキペディアで「Pinsker's inequality」の詳細全文を読む



スポンサード リンク
翻訳と辞書 : 翻訳のためのインターネットリソース

Copyright(C) kotoba.ne.jp 1997-2016. All Rights Reserved.